Pull request overview

This PR refactors variable-length record storage in the DataCell layer by introducing reusable layout primitives (explicit byte-range addressing plus policy-based variable record locations) and migrating SparseVectorDataCell / MultiVectorDataCell to use them while preserving existing on-disk schemas.

Changes:

• Added ByteRangeLayout for explicit (offset, length) access over opaque bytes and IO delegation/serialization.
• Added VariableRecordLayout composed of FixedLayout (locations) + ByteRangeLayout (payload), with pluggable location policies.
• Migrated SparseVectorDataCell and MultiVectorDataCell to the new layout abstractions while keeping v2 + legacy serialization compatibility.

Reviewed changes

Copilot reviewed 8 out of 8 changed files in this pull request and generated 4 comments.

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

Pull request overview

Copilot reviewed 8 out of 8 changed files in this pull request and generated 2 comments.

    const auto load_location = [this](InnerIdType id) {
        DocLocation location{};
        return layout_.ReadLocation(id);
    };

    // Step 1: Read all offsets (offset_io_ is MemoryBlockIO, in-memory, fast)
    std::vector<uint64_t> offsets(id_count);
    for (InnerIdType i = 0; i < id_count; ++i) {
        offsets[i] = layout_.ReadLocation(idx[i]);

Pull request overview

Copilot reviewed 8 out of 8 changed files in this pull request and generated no new comments.

    const auto load_location = [this](InnerIdType id) {
        DocLocation location{};
        return layout_.ReadLocation(id);
    };

    void
    Prefetch(uint64_t offset, uint64_t length) {
        io_->Prefetch(offset, length);
    }